Controllability and Observability 


Controllability and observability represent two major concepts of modern control 
system theory. These concepts were introduced by R. Kalman in 1960. They can 
be roughly defined as follows. 

Controllability: In order to be able to do whatever we want with the given 
dynamic system under control input, the system must be controllable. 

Observability: In order to see what is going on inside the system under obser¬ 
vation, the system must be observable. 

In this lecture we show that the concepts of controllability and observability are 
related to linear systems of algebraic equations. It is well known that a solvable 
system of linear algebraic equations has a solution if and only if the rank of the 
system matrix is full . Observability and controllability tests will be connected to 
the rank tests of ceratin matrices: the controllability and observability matrices. 
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5.1 Observability of Discrete Systems 

Consider a linear, time invariant, discrete-time system in the state space form 

x(fc + 1) = A ^x(fc), x(0) = x 0 = unknown (5.1) 

with output measurements 

y(k) = C d x(k) (5.2) 

where x(k) G y(fc) G ffl 3 . A d and C</ are constant matrices of appropriate 
dimensions. The natural question to be asked is: can we learn everything about 
the dynamical behavior of the state space variables defined in (5.1) by using only 
information from the output measurements (5.2). If we know x 0 , then the recursion 
(5.1) apparently gives us complete knowledge about the state variables at any 
discrete-time instant. Thus, the only thing that we have to determine from the 
state measurements is the initial state vector x(0) = x 0 . 

Since the n-dimensional vector x(0) has n unknown components, it is expected 
that n measurements are sufficient to determine x 0 . Take k = 0,1 ,n — 1 in (5.1) 
and (5.2), i.e. generate the following sequence 

y(o) = Cjx(o) 

y(i) = Qx(i) = C f /Ajx(0) 

y(2) = C f /x(2) = C f /Ajx(l) = C,/A x(0) (5.3) 


y (n - 1) = Cjx(n - 1) = C d A n d x x(0) 
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y(o) 1 

(np)x 1 

c d 

y(i) 


C d A d 

y(2) 

— 

CdAj 

_y(n - 1)_ 


c d A 


x x(0) 


(5.4) 


We know from linear algebra that the system of linear algebraic equations with n 
unknowns, (5.4), has a unique solution if and only if the system matrix has rank n. 


rank 


C d A d 

C d A 2 d 




n —1 


= n 


(5.5) 


The initial condition xq is determined if the so-called observability matrix 


0(A d ,Cd) 


C d 

C d A d 


lCdA d 


n—1 


(np)xn 


(5.6) 


has rank n, that is 


rank(9 = n 


(5.7) 



4 


CONTROLLABILITY AND OBSERVABILITY 


Theorem 5.1 The linear discrete-time system (5.1) with measurements (5.2) is 
observable if and only if the observability matrix (5.6) has rank equal to n. 


Example 5.1: 

Consider the following system with measurements 


x\(k, + 1 ) 


'1 

2' 


xi(k) 

x-}(k + 1) 


3 

4 


X2 {k) 


y(k) = [1 


2 ] 


xi(k ) 
X2 (k) 


The observability matrix for this second-order system is given by 


' c d 


'1 

2 ' 

CdA d _ 


7 

10 


Since the rows of the matrix O are linearly independent, then raiik(9 = 2 = n, i.e. 
the system under consideration is observable. Another way to test the completeness 
of the rank of square matrices is to find their determinants. In this case 


det O = —4 0 44 full rank = n = 2 
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Example 5.2: 

Consider a case of an unobservable system, which can be obtained by slightly 
modifying Example 5.1. The corresponding system and measurement matrices are 
given by 


A d = 

The observability matrix is 


1 -2 
-3 -4 


, C d = [l 2] 


(9 = 


1 2 
-5 -10 


so that rank(9 = 1 < 2, and the system is unobservable. 
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5.2 Observability of Continuous Systems 

For the purpose of studying its observability, we consider an input-free system 

x(t) = A x(t), x(to) = x 0 = unknown (5.8) 

with the corresponding measurements 

y (t) = Cx(t) (5.9) 

of dimensions x(t) G y(t) G A G 9ft ??xn , and C G 3£ pxn . Following the 
same arguments as in the previous section, we can conclude that the knowledge of 
x 0 is sufficient to determine x(t) at any time instant, since from (5.8) we have 

x(t) = e A( *~ io) x(io) (5.10) 

The problem that we are faced with is to find x(to) from the available measurements 
(5.9). We have solved this problem for discrete-time systems by generating the 
sequence of measurements at discrete-time instants k = 0,1,2 ,n — 1. Note 
that a time shift in the discrete-time corresponds to a derivative in the continuous¬ 
time. An analogous technique in the continuous-time domain is obtained by taking 
derivatives of the continuous-time measurements (5.9) 

y(£ 0 ) = Cx(t 0 ) 
y(£ 0 ) = Cx(t 0 ) = CAx(to) 
y(£ 0 ) = Cx(t 0 ) = CA 2 x(£ 0 ) 

y (n_1) (t 0 ) = Cx ( " rs (/ 0 ) = CA n_1 x(f 0 ) 


(5.11) 
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Equations (5.11) comprise a system of np linear algebraic equations. They can be 
put in matrix form as 


y(*o) 

(np)xl 

c 

(np)xn 

y(*o) 


CA 


y(*o) 

— 

CA 2 

x x(to) = ^x(to) - Y(/o) (5.12) 



CA"- 1 



where O is the observability matrix already defined in (5.6) and where the definition 
of Y(to) is obvious. Thus, the initial condition x(to) can be determined uniquely 
from (5.12) if and only if the observability matrix has full rank, i.e. rank(2 = n. 

Theorem 5.2 The linear continuous-time system (5.8) with measurements (5.9) 
is observable if and only if the observability matrix has full rank. 

It is important to notice that adding higher-order derivatives in (5.12) cannot 
increase the rank of the observability matrix since by the Cayley-Hamilton theorem 
for k > n we have 

n— 1 

A Vo A (5.13) 

z=0 

so that the additional equations would be linearly dependent on the previously 
defined n equations (5.12). 
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5.3 Controllability of Discrete Systems 

Consider a linear discrete-time invariant control system defined by 

x(fc + 1) = A rfx(fc) + Brfu(fc), x(0) = x 0 (5.14) 

The system controllability is roughly defined as an ability to do whatever we want 
with our system, or in more technical terms, the ability to transfer our system from 
any initial state x(0) = x 0 to any desired final state x(fci) = xy in a finite time, i.e. 
for k\ < oo (it makes no sense to achieve that goal at k\ = oo). Thus, the question 
to be answered is: can we find a control sequence u(0),u(l),... ,u(n — 1), such 
that x(fc) = x/-? 

Let us start with a simplified problem, namely let us assume that the input u (k) 
is a scalar, i.e. the input matrix B d is a vector denoted by b d . Thus, we have 

x(fc + 1) = A dx(k) + b du(k), x(0) = x 0 (5.15) 

Taking k = 0,1, 2, ...,n in (5.15), we obtain the following set of equations 

x(l) = Ajx(0) + b d u(0) 

x(2) = Ajx(l) + h d u(l) = Ajx(0) + A d b d u(0) + b^(l) 

. (5.16) 

x(n) = A ? f ]x(0) + A^~ 1 b d u(0) H-h b d u(n - 1) 
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x («) - A 2 X (°) = 


b d • A,/b 


cm 


a r 1 ^ 


u(n — 1) 
u(n — 2) 

“(!) 

u( 0) 


(5.17) 


Note that b^iA^b^! • • • -A'j l h c i is a square matrix. We call it the controllability 
matrix and denote it by C. If the controllability matrix C is nonsingular, equation 
(5.17) produces the unique solution for the input sequence given by 


u(n — 1) 
u(n — 2) 


“(!) 

w(0) 


= C 1 (x(ti.) A^x(0)) 


(5.18) 


Thus, for any x(n) = xy, the expression (5.18) determines the input sequence 
that transfers the initial state x 0 to the desired state xy in n steps. It follows 
that the controllability condition, in this case, is equivalent to nonsingularity of the 
controllability matrix C. 
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In a general case, when the input u (k) is a vector of dimension r, the repetition 
of the same procedure as in (5.15)—(5.17) leads to 

u(n — 1) 
u (n — 2) 

x(n) - Ajx(0) = \B d i A d B d i • • • i A^bJ ! (5.19) 

u(l) 

L u(0) _ 

The controllability matrix, in this case, defined by 

C( A d , B d ) = [b ( , ; A d B d ■:■■■ l Ar'Brf] (5.20) 

is of dimension n x r • n. The system of n linear algebraic equations in r • n 
unknowns for n r-dimensional vector components of u(0), u(l),..., u(n — 1), is 

r ( \ \ “i !'"') x i 

u(n — 1) 

u(n — 2) 

c nx{nr) : = x(n) - A3x(0) = X/ - A3x(0) (5.21) 

u(l) 

L u (°) J 

will have a solution for any xy if and only if the matrix C has full rank, i.e. 
rank C = n. 

Theorem 5.3 The linear discrete-time system (5.14) is controllable if and only if 

rank C = n (5.22) 

where the controllability matrix C is defined by (5.20). 
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5.4 Controllability of Continuous Systems 


Studying the concept of controllability in the continuous-time domain is more 
challenging than in the discrete-time domain. At the beginning of this section we 
will first apply the same strategy as in Section 5.3 in order to indicate difficulties that 
we are faced with in the continuous-time domain. Then, we will show how to find 
a control input that will transfer our system from any initial state to any final state. 

A linear continuous-time system with a scalar input is represented by 


x = Ax + tm, x(to) = x 0 (5.23) 

Following the discussion and derivations from Section 5.3, we have, for a scalar 
input, the following set of equations 


x = —pX = Ax + tm 

jj- 


dt 

d 2 


x = 


= —yX = A 2 x + Atm + tm 


(5.24) 


d n 

(n) = Y-x = A"x + A" _1 bu + A” -2 bu + • • • + bu ( " _1) 
dt n 


x 
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u {n - 2 >(t) 

x (n \t)-A"x(t) =C ■: (5.25) 

u(t) 

u(t) 

Note that (5.25) is valid for any t £ [to, t/] with tf free but finite. Thus, the 
nonsingularity of the controllability matrix C implies the existence of the scalar 
input function u(t) and its n — 1 derivatives, for any t < tf < oo. 

For a vector input system dual to (5.23), the above discussion produces the same 
relation as (5.25) with the controllability matrix C given by (5.20) and with the 
input vector u(t) £ 3ft r , that is 

u("- 2 )(£) 

C nxm ' n \ = x <n >(t)~ A n x(t) = 7 (t) (5.26) 

ii(t) 

l u(i) J 

It is well known from linear algebra that in order to have a solution of (5.26), it 
is sufficient that 

rankC = rank C ! 7 (t) (5.27) 

Also, a solution of (5.26) exists for any 7 (t )—any desired state at t —if and only if 

rankC = n (5.28) 
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From Section 3.2 we know that the solution of the state space equation is 


to 


x(t) = e A ( t_t °)x(fo) + /^Bufr). 
At the final time t\ we have 

x(ti) = x/- = e A (h-^o), 




^x(to) + y*e A ^ 1 7 ^Bu(r)rir 


or 


t[) 

h 


e Atl Xf — e At °x(to) = y*e At Bu (r)dr 


to 

Using the Cayley-Hamilton theorem, that is 

n— 1 

e -Ar = ^ a! (r)A ! 
i=0 

where cl z (t), i = 0,1, ...,n — 1, are scalar time functions, we have 

i t 1 

n — 1 i 

e _Ail xj — e _At °x(to) = A B / CL z (r)u(r)<iT 

? = ° to 


(5.29) 
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e A< 1 x/ — e At °x(to) 


BiAB: ••• :A n_1 B 


1 1 

/ 

/ 


CLo(r)u(r)(iT 

cli(t)u(t)c?t 


1 1 

/ CLn-i(r)u(r)c?r 
Jo 


On the left-hand side of this equation all quantities are known, i.e. we have a 
constant vector. On the right-hand side the controllability matrix is multiplied by 
a vector whose components are functions of the required control input. Thus, we 
have a functional equation in the form 


const"* 1 = C(A,B)" xrn 


fi( U (r)) 

f 2 (u(r)) 


rnx 1 




f n —i(u(r)) 


t £ (to,^l) 


(5.30) 


A solution of this equation exists if and only if rankC(A,B) = n, which is the 
condition already established in (5.28). In general, it is very hard to solve this 
equation. One of the many possible solutions of (5.30) will be given in Section 5.8 
in terms of the controllability Grammian. 

Theorem 5.4 The linear continuous-time system is controllable if and only if the 
controllability matrix C has full rank, i.e. r an k C = n. 




CONTROLLABILITY AND OBSERVABILITY 


15 


Example 5.3: Given the linear continuous-time system 


X = 

" 0 

3 

1 

-4 

-2" 

5 

x + 

"0 

2 

1 

j —\ CO 

1 1 


-6 

7 

8 


4 

-5 


u 


The controllability matrix for this third-order system is given by 


C = 


B ! AB ! A B 


0 

-1 i 

-6 

7 

2 

-3 i 

12 

-10 

4 

-5 i 

46 

-55 


A 2 B 


Since the first three columns are linearly independent we can conclude that raiikC = 
3. Hence there is no need to compute A 2 B since it is well known from linear 
algebra that the row rank of the given matrix is equal to its column rank. Thus, 
raiikC = 3 = n implies that the system under consideration is controllable. 
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5.5 Additional Controllability/Observability Topics 

Invariance Under Nonsingular Transformations 

We will show that both system controllability and observability are invariant 
under similarity transformation. 

Consider the vector input form of (5.23) and the similarity transformation 

x = Px (5.31) 

such that 

& = Ax + Bu 

A | A 

where A = PAP - and B = PB. Then the following theorem holds. 

Theorem 5.5 The pair (A, B) is controllable if and only if the pair ^A,B^ is 
controllable. 

This theorem can be proved as follows 

\ AAA A 1 A 

J = B : AB : • • • : A" _1 B 
= PB • PAP _1 PB • • • • i PA" _1 P _1 PB 
= P [b I AB i • • • ■ A" _1 b1 = PC(A, B) 


C A,B 
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Since P is a nonsingular matrix (it cannot change the rank of the product PC), 
we get 

rankC ^A, = rankC(A, B) 

A similar theorem is valid for observability. The similarity transformation (5.32) 
applied to (5.8) and (5.9) produces 

♦ A 

A A A 

x = Ax 
y = Cx 

where 

C = CP -1 

Then, we have the following theorem 

Theorem 5.6 The pair (A, C) is observable if and only if the pair ^A, is 
observable. 

The proof of this theorem is as follows 

'ci r cp _1 i c 

CA CP _1 PAP _1 CA 

£>(a,c) = CA 2 = CP _1 PA 2 P _1 = CA 2 P _1 

CA"- 1 CP _1 PA" _1 P _1 CA" -1 
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e>(A,c) =0(A,C)P“ 1 

The nonsingularity of P implies 

rank O ^A, = rank(9(A, C) 

which proves the stated observability invariance. 

Frequency Domain Controllability and Observability Test 

Controllability and observability have been introduced in the state space domain 
as pure time domain concepts. It is interesting to point out that in the frequency 
domain there exists a very powerful and simple theorem that gives a single condition 
for both the controllability and the observability of a system. It is given below. 

Let H(s) be the transfer function of a single-input single-output system 

H(s) = c(sl- A) _1 b 

Note that H (s) is defined by a ratio of two polynomials containing the corresponding 
system poles and zeros. The following controllability-observability theorem is 
given without a proof. 

Theorem 5.7 If there are no zero-pole cancellations in the transfer function 
of a single-input single-output system, then the system is both controllable and 
observable. If the zero-pole cancellation occurs in H ( s ), then the system is either 
uncontrollable or unobservable or both uncontrollable and unobservable. 



CONTROLLABILITY AND OBSERVABILITY 


19 


Example 5.4: Consider a linear continuous-time dynamic system represented 
by its transfer function 

tt( \ = _ ( s + 3 ) _ = s + 3 

(s + l)(s + 2 )(s + 3) s 3 + 6s 2 + 11s + 6 

Theorem 5.7 indicates that any state space model for this system is either uncon¬ 
trollable or/and unobservable. To get the complete answer we have to go to a state 
space form and examine the controllability and observability matrices. One of the 
possible many state space forms of H(s) is as follows 



—6 —11 —6 x\ 1 

1 0 0 x -2 + 0 u 

0 1 0 x% 0 


y = [0 1 3 ] X 2 

_X3_ 

It is easy to show that the controllability and observability matrices are given by 

"1 -6 25 1 |" 0 1 3 

C = 0 1 — 6 , O — 1 3 0 

0 0 1 J L-3 “ n “ 6 

Since 

det C = 1 7 ^ 0 =y rankC = 3 = n 
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and 


det O = 0 =>- rank(9 <3 — n 


this system is controllable, but unobservable. 

Note that, due to a zero-pole cancellation at s = — 3, the system transfer function 
H(s) is reducible to 

"M = - (.+ l),. + 2) - ram 

so that the equivalent system of order n = 2 has the corresponding state space form 





y = [ o 



For this reduced-order system we have 



(9 = 




and therefore the system is both controllable and observable. 

Interestingly enough, the last two mathematical models of dynamic systems of 
order n = 3 and n = 2 represent exactly the same physical system. Apparently, the 
second one (n = 2) is preferred since it can be realized with only two integrators. 
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It can be concluded from Example 5.4 that Theorem 5.7 gives an answer to the 
problem of dynamic system reducibility. It follows that a single-input single-output 
dynamic system is irreducible if and only if it is both controllable and observable. 
Such a system realization is called the minimal realization. If the system is either 
uncontrollable and/or unobservable it can be represented by a system whose order 
has been reduced by removing uncontrollable and/or unobservable modes. It can 
be seen from Example 5.4 that the reduced system with n = 2 is both controllable 
and observable, and hence it cannot be further reduced. This is also obvious from 
the transfer function H r (s). 

Theorem 5.7 can be generalized to multi-input multi-output systems, where 
it plays very important role in the procedure of testing whether or not a given 
system is in the minimal realization form. The procedure requires the notion of the 
characteristic polynomial for proper rational matrices which is beyond the scope of 
this book. Interested readers may find all details and definitions in Chen (1984). 

It is important to point out that the similarity transformation does not change the 
transfer function as was shown in Section 3.4. 
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Controllability and Observability of Special Forms 

In some cases, it is easy to draw conclusions about system controllability and/or 
observability by examining directly the state space equations. In those cases there 
is no need to find the corresponding controllability and observability matrices and 
check their ranks. 

Consider the phase variable canonical form with 

x = Ax + Bu 
y = Cx 

where 



" 0 

1 

0 

0 


"o" 


0 

0 

1 

0 


0 

A = 

0 

0 

0 

1 

, B = 

0 


~ 0 {) 

—a\ 

— «2 ' ' ' 

fill— 1 


1 


C = [l 0 0 ... 0] 

This form is both controllable and observable due to an elegant chain connection of 
the state variables. The variable x\(t) is directly measured, so that X 2 (t) is known 

from x- 2 (t) = x\(t). Also, x$(t) = X2(t) = x\(t), and so on, x n (t) = x'l l \t). 

Thus, this form is observable. The controllability follows from the fact that all state 
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variables are affected by the control input, i.e. x n is affected directly by u(t) and 
then x n -i(t) by x n (u(t )) and so on. The control input is able to indirectly move 
all state variables into the desired positions so that the system is controllable. This 
can be formally verified by forming the corresponding controllability matrix and 
checking its rank. This is left as an exercise for students (see Problem 5.13). 

Another example is the modal canonical form. Assuming that all eigenvalues 
of the system matrix are distinct, we have 

x = Ax + Tu 
y = Dx 

where 



"Ai 

0 

... 0 ■ 


71 

A = 

0 

A2 

... 0 

, r = 

72 


0 

0 

• •' A n 


7 n 


£> — \t\ fa • • • <y 

We are apparently faced with n completely decoupled first-order systems. Obvi¬ 
ously, for controllability all 7 *, i = 1 ,..., n, must be different from zero, so that 
each state variable can be controlled by the input u (t). Similarly, 6 l / 0, i = 
1 ,,n, ensures observability since, due to the state decomposition, each system 
must be observed independently. 
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The Role of Observability in Analog Computer Simulation 

In addition to applications in control system theory and practice, the concept of 
observability is useful for analog computer simulation. Consider the problem of 
solving an nth-order differential equation given by 


n m 

„.(n) i \ A ^ fn— i) \ ' 7 fm— i) 

V T / fin HJ — / j bm—i.U 
i —1 2=0 

with known initial conditions for y(0), y(0),?/( n_1 )(0). This system can be 
solved by an analog computer by using n integrators. The outputs of these n 
integrators represent the state variables aq, X 2 ,x n , so that this system has the 
state space form 


x = Ax + bn, x(0) = unknown 
V = cx 

However, the initial condition for x(0) is not given. In other words, the initial 
conditions for the considered system of n integrators are unknown. They can be 
determined from y(0),y(0), ...,y^ n ~^(0) by following the observability derivations 
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performed in Section 5.2, namely 
2 /(0) = cx(0) 

2 /(0) = cx(0) = cAx(O) + ctm(0) 
i/(0) = cx(0) = cA 2 x(0) + cAbit(O) + cTm(O) 

= cx (li—1) (0) = cA" _1 x(0) + cA" _2 bu(0) 

+ cA n_ ' ! b«(0) + • " + cAb(i"~ l, (0) + cbi/ l " _ " l (b) 

This system can be written in matrix form as follows 

y( °) 
y(°) 

_y {n ~ l) { o) 

where O is the observability matrix and T is a known matrix. Since 
u(0),u(0), ?/ n_1 )(0) are known, it follows that a unique solution for x(0) 
exists if and only if the observability matrix, which is square in this case, is 
invertible, i.e. the pair (A,c) is observable. 


= o • x(o) + r 

0 

u( 0) 


i 

g 

. 0-1 

1 

e 

S 

_ i 


(5.32) 
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Example 5.5: Consider a system represented by the differential equation 

t > 0 


^ +4 ^ +4y ~^ +u ’ ?/(0) “ 2 ’ ^ (0) “ 1 ’ “W- e ~ 4 '= 


Its state space form is given by 

x = Ax + tm = 


0 1 
-4 -4 


x + 


u 


y = cx = [1 1 ]x 

The initial condition for the state space variables is obtained from (5.33) as 


c 

cA 


x (o) 


y(o) 

j(o) 


leading to 


1 1 
-4 -3 


x(0) 


2 

0 


0 

ctm(O) 


x (o) 


aq (0) 


'- 6 ' 

jE 2 (0)_ 


8 


This means that if analog computer simulation is used to solve the above second- 
order differential equation, the initial conditions for integrators should be set to 
—6 and 8. 
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Stabilizability and Detectability 

So far we have defined and studied observability and controllability of the 
complete state vector. We have seen that the system is controllable (observable) if 
all components of the state vector are controllable (observable). The natural question 
to be asked is: do we really need to control and observe all state variables? In 
some applications, it is sufficient to take care only of the unstable components of 
the state vector. This leads to the definition of stabilizability and detectability. 

Definition 5.1 A linear system (continuous or discrete) is stabilizable if all 
unstable modes are controllable. 

Definition 5.2 A linear system (continuous or discrete) is detectable if all unstable 
modes are observable. 

The concepts of stabilizability and detectability play very important roles in 
optimal control theory, and hence are studied in detail in advanced control theory 
courses. For the purpose of this course, it is enough to know their meanings. 



